Two-dimensional Dirac fermions in a topological insulator: transport in the quantum 

limit 
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Pulsed magnetic fields of up to 55T are used to investigate the transport properties of the topo- 
logical insulator Bi2Se3 in the extreme quantum limit. For samples with a bulk carrier density of 
n — 2.9 X lO^^cm"^, the lowest Landau level of the bulk 3D Fermi surface is reached by a field of 
4T. For fields well beyond this limit, Shubnikov-de Haas oscillations arising from quantization of 
the 2D surface state are observed, with the v =1 Landau level attained by a field of ~ 35T. These 
measurements reveal the presence of additional oscillations which occur at fields corresponding to 
simple rational fractions of the integer Landau indices. 
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The recent prediction and discovery that Bi2Se3 and 
Bi2Te3 are three-dimensional topological insulators (TI) 
[ij-Q has sparked a flurry of investigations. In a mag- 
netic field, their relativistic dispersion causes the energy 
spectrum to be quantized so that Ey oc V Bv, where B is 
the magnetic field and v = 1,2, 3, .., is the energy level, 
knovifu as the Landau level (LL). The progression of en- 
ergy levels Eu has been recently observed in scanning- 
tunneling microscopy (STM) on BiaSeaiO- Other ex- 
periments on bulk samples and nanoribbons have re- 
ported universal conductance fluctuations attributed to 
the surface stated, However, all of the unambiguous 
measurements for the existence of the surface state have 
been made by surface sensitive probes. In this letter, 
we study samples of (Bii_a;Sba;)2Se3 in which the Fermi 
surface of the Dirac fermions is small enough that pulsed 
fields of up to 55 T can access their quantum limit - the 
limit in which only a few of the lowest LLs are occu- 
pied. This is achieved by depleting the carrier density of 
the bulk and thereby reducing the size of the Dirac Fermi 
surface [13, Ell)- We demonstrate for the first time, a sys- 
tem in which not only the transport properties of Dirac 
fermions can be studied, but studied in the 2D quantum 
limit where novel correlation effects are most likely to 
arise [mil. 

Generally speaking, transport measurements in Bi2Se3 
and Bi2Te3 are plagued by bulk conducting channels 
from either the conduction band or by impurity bands 
introduced by foreign dopants IJ, [l5|. The materials 
challenge is therefore finding a way to cleanly eliminate 
the bulk conductivity so that the properties of the sur- 
face can be observed. However, the carrier densities re- 
ported to date in studies of TI remain only as low[i-[i 
as ~10^^cm~'^. It has been known for some time that 
substituting isovalent Sb for Bi can reduce the size of the 
Fermi surface while retaining high mobilities [l6| . By uti- 

we 



lizing this idea and an optimized growth technique [11 



have reduced the bulk carrier density and corresponding 
Fermi surface systematically, while increasing the bulk 



resistivity by several orders of magnitude. 

Crystals with bulk carrier densities of 2300x lO^^cm""^ 
and 33xl0^^cm~^ (red and orange curves on Figure 1 
(a)) were obtained by slow cooling a binary melt with 
different Bi:Se ratio. The principal origin of these rela- 
tively high carrier densities is Se deficiency and antisite 
defects. Samples with n< 11 x lO^^cm"-^ were obtained 
by slow cooling a ternary melt containing progressively 
more Sb. Although Sb is isovalent with Bi, Sb substi- 
tution apparently acts to control the defect density in 
the bulk crystals, reducing the bulk carrier density. Be- 
fore measurements were performed, samples were cleaved 
on both sides with a scalpel blade in a dry atmosphere, 
mounted with contacts (using conductive silver epoxy) 
and pumped to 10~^mbar within 20 minutes. The leads 
made contact along the sides of the crystal to maximize 
the contact with the bulk. All samples were measured us- 
ing a standard 4-probe configuration. Magnetoresistance 
and Hall effect measurements were performed at the Na- 
tional High Magnetic Field Laboratory (Los Alamos) in 
the short pulse (~10ms rise time) 55T magnet. Sweeps at 
both negative and positive field polarities were measured 
for all temperatures and angular positions. The data 
were then 'symmetrized' by combining the data from each 
field polarity to extract the components that are even in 
magnetic field (longitudinal magnetoresistance, Rxx) and 
odd in magnetic field (Hall resistance, Rxy)- 

In Figure [T] we illustrate the dependence of the resis- 
tivity on temperature for various samples with different 
carrier densities. The carrier density is determined by 
the (low field) Hall effect and can be matched to the size 
of the Fermi surface measured by quantum oscillations, 
which in resistivity are denoted Shubnikov-de Haas oscil- 
lations (SdHO) (see Figure [I](b) to (d)). These oscilla- 
tions are periodic in inverse field and their period T can 
be related to the extremal cross sectional area Ak of the 
Fermi surface in momentum space via the Onsager rela- 
tion 1/T = {h/2TTe)Ak- When the field is rotated about 
the crystal trigonal axis, the frequency of the SdHO 
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FIG. 1: (a) Progressively reducing the bulk carrier density in Bi2Se3 results in a significantly increased resistivity. A reduction 
in the carrier density from n=2300 x lO^^cm"^ to 33xl0^®cm~'^ was achieved by varying the growth conditions for a binary 
melt. Further reduction in the bulk carrier density down to n= 2.9 x 10^'' was achieved by isovalent substitution of Sb for 
Bi. (b-d) Representative magnetoresistance data at 2K for samples with indicated carrier densities, for field oriented along the 
trigonal c-axis. The progressive reduction of the Fermi surface volume is evident from the stretching of the SdH oscillations, 
(e-g) Carrier densities are extracted for each of these samples from the (low field) Ifall effect. These are in very good agreement 
with those expected from the size of the Fermi surface (which shrinks monotonically as shown schematically in the lower right 
of each plot, with Fermi wavevector kp indicated). For the lowest carrier density samples shown in panels (e) and (f), the Hall 
signal deviates from linearity as the field approaches the 3D (bulk) quantum limit. 



changes according to the morphology of the Fermi sur- 
face. In every one of our samples the bulk Fermi surface 
is a closed three-dimensional ellipsoid flU, [13, 13] • The ef- 
fective mass m* ~ 0.12me varies weakly with doping for 
these carrier densities, as previously reported |17l. llSlj). 
For our lowest carrier density sample, the pocket is ex- 
pected to have an orbitally averaged Fermi wavenumber 
of kp — 0.0095A~^. With such a small Fermi surface 
we are able to exceed the bulk 3D quantum limit with 
moderate fields ~ AT. The remainder of this study is 
dedicated to the properties of the lowest carrier density 
samples at high fields. 

In Figure [5] (a) we illustrate the symmetrized data 
for the longitudinal and transverse (Hall) resistances, 
Rxx and R^y respectively, taken at 1.5 K on a sam- 
ple (of carrier density 3 x lO^^cm"^) of dimensions 
^.63x.36x.l5 mm^. Strong features appear in the Rxy 
and Rxx signal at similar fields [l^. To investigate the 
dimensionality of the physics underlying these features, 
we rotate the crystal about the field, defining = to be 
when the field is perpendicular to the surface (parallel to 
the trigonal c-axis). For the 2D surface state of a topo- 
logical insulator, quantum oscillatory phenomena depend 
only on the perpendicular component of the field B_i, 
and despite the peculiar Landau quantization E^, the 
SdHO are still periodic in 1/B;20]. In Figure [l](b) and 



(c) we have plotted the dRxy/dB and —cPRxx/dB^ as a 
function of B± = Bcosd - this would be the usual proce- 
dure to determine whether minima in the Rxx (equivalent 
to minima in the negative second derivative) fall on top 
of the Hall plateaus (appearing as minima in the first 
derivative). Two pronounced dips in the Hall derivative 
are observed to correspond with the same dips in the 
magnetoresistance at all angles. The periodicity in 1/B 
of the minima indicates they arise from Landau quanti- 
zation. In contrast to the angle dependence of the bulk 
Fermi surface of higher carrier density samples Ill.ll7lll8| 
these features scale with 1/cos^, providing unambiguous 
evidence that the plateau-like features in the Hall and 
minima in the SdHOs originate from a 2D metallic state. 

Examining Figure [5] (b) the second and third minima 
occur at twice and three times the value in 1/B of the 
first, and it is natural to assign the indices v = 1,2,3 
as shown. We plot these indices as a function of 1/B± 
in Figure [3] (c) which connect a straight line through the 
origin. The plateau-like features in Rxy are reminiscent of 
the quantum Hall effect in 2D electron gases [iili^, but 
in the present case the quantization in integer multiples 
of tTo = e^/h is not evident ^2 11]. This can be attributed to 
the presence of a large parallel conductance channel from 
the bulk. Nevertheless, this data conclusively shows that 
we are able to get to the quantum limit of the 2D state. 
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FIG. 2: (a) R^^ AnAR^y data traces as a function of magnetic field for indicated angles for a single crystal with n~ SxlO^^cm"^. 
The Rxx traces are offset by +2.5 fi. The deviation from linearity of the low-field R^y indicates the 3D quantum limit {B ~ 4T). 
Beyond this limit, additional features in both R^y and R^^^ move smoothly up in field as the tilt angle 6 is increased. In contrast, 
the 3D quantum limit is independent of tilt angle, (b, c) —d? R^x/dB^ and dRxy/dB as a function of 1/-B±, where B±_ — Bcosd 
which aligns all features associated with the 2D surface state. The vertical lines are evenly spaced in 1/B± and correspond to 
the filling of the first three energy levels 2^=1,2,3 of the 2D state. 



The obvious candidate for the origin of the 2D states is 
the surface Dirac fermions. 

A crude method to confirm that the effect is surface re- 
lated is to briefly expose the sample to atmosphere. The 
atmosphere is a known n-type dopant of the surface 11 
so that bulk carriers from the conduction band begin to 
contribute, smearing the surface signal. After 1-2 hours 
exposure the oscillatory phenomena we see in Figures [2] 
and [3] are almost completely absent (see Figure E]). We 
therefore conclude that the observed signal does indeed 
originate from the surface state of the TI. With this iden- 
tification, we can determine the position of the Fermi 
energy on the Dirac cone from the period T of the os- 
cillations. The Fermi wave vector kp oi the surface state 
can be calculated from the Onsager relation above, yield- 
ing kp — O.OSlA^^. Using the Fermi velocity measured 
by photoemission vp = 4.2 x lO^ms"-'^ llj, the Fermi en- 
ergy is estimated to be ~90meV above the Dirac point, 
or ~110meV below the conduction band (see inset Figure 
131(c)). 

It is important to distinguish this work from previ- 
ous (unambiguous) measurements of the Dirac fermion, 
which have been mostly done in zero field [2-11]. The high 
magnetic field lifts the degeneracy of the Dirac cone at 
the Dirac point (defined in left inset Fig. [3] (c)) via the 
spin (Zeeman) coupling to the magnetic field, such that 
the quasiparticle gains a mass [251 . From the temperature 
dependence of the quantum oscillations we can estimate 
a cyclotron mass m* cx dAk/dE to be O.llme for the sur- 
face fermions. It should be noted that even for a band 



with linear dispersion this value is finite and related to 
the Fermi velocity vp and the band filling "2^. In the 
present case vp = 4.2 x lO^ms"^ and Ep — 90meV (see 
below) would give m* = 0.089me. The difference with 
the measured mass provides a measure of the band cur- 
vature of the split bands. This splitting fundamentally 
changes the topology of the Dirac cone. In an unsplit sys- 
tem, like graphene, the crossing at the Dirac point gives 
a Berry's phase factor which results in a finite index in- 
tercept at 1/2 2^ irl .W hen the Dirac cone is split (the 
fermions are massive'25'|), this Berry's phase should not 
exist, suggesting that the plot of vs 1/B extrapolates 
to (0,0)[27|, as is presently observed (see Figure |3] (c)). 
Our data is therefore consistent with the observation of 
this surface state with a split Dirac cone. 

In Figure[3](a) and (b) we plot —d^Rxx/dB'^ vs 1/B±^ 
in the range < < 1 and 1 < < 2 respectively. 
Minima in the signal emerge at each angle which line 
up when plotted as a function of 1/B±, and therefore 
also evidence 2D physics. These minima are not periodic 
in inverse field and cannot originate from another Fermi 
surface. They are also reproducible using different sweep 
rates of the pulsed magnetic field and thus cannot be 
artifacts of the pulsed magnet environment that are pe- 
riodic in time. Intriguingly, these minima fall very near 
simple rational fractions of 2/3, 5/7 and 4/5 (in Fig. [3] 
(a) as well as 6/5, 4/3, 3/2 and 5/3 (in Fig. ^h)). 

Aperiodic 'oscillations' are typical of quantum interfer- 
ence phenomena in mesoscopic systems, and we cannot 
rule out the possibility that this is the origin of the addi- 
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FIG. 3; (a) -cPR^^/dB^ as a function of 1/Bx in the field 
range for which < 1 for 61 = 0°, 9.1°, 19.9° and 26.8° (top to 
bottom), illustrating three additional features at fields corre- 
sponding to fractional landau indices, (b) The same signal for 
the field range for which 1 < v <2 for angles 6 = 0°, 19.9°, 
43.1°, 55.7°, 58.7°, illustrating four further features. These 
additional oscillations scale with the the perpendicular com- 
ponent of the field to the surface just as in Figure[2l illustrat- 
ing that they must also originate from the 2D surface state. 
Assigning indices for these features based on the integer in- 
dices gives values oiv ^ 0.665±0.005, 0.72±0.01, 0.805±0.005 
for < 1 and 1.19 ± 0.02, 1.32 ± 0.02, 1.51 ± 0.03, 1.65 ± 0.03 
for 1 < V < 2, (counting from small to large 1/B). Vertical 
lines are drawn in panels (a) and (b) corresponding to the 
nearest fractional Landau filling, (c) LL index z/ as a function 
of inverse field. Large symbols show integer levels v = 1,2, 3. 
Small symbols show fractional features observed in panels (a) 
and (b). The data are fit by straight line. The period of the 
integer states gives an estimate of the surface state Ef, which 
would cross 90 meV above the Dirac point corresponding to 
llOmeV below the conduction band as shown in the schematic 
(upper left inset) [lH . 



14 



10 



8 

i 6 



Initial experiment 

After l-2hrs exposure ^x"' 



- / 

I 

I 
I 



10 20 30 40 50 

S(T) 

FIG. 4: The R^x (dash-dot line) and Rxy (dashed line) signal 
shown in green before exposure shows the oscillations related 
to the 2D state. The red curves show the signal after this 
sample is exposed to atmosphere for 1-2 hours, with greatly 
suppressed oscillatory signal in Rxx, and no apparent signa- 
ture in Rxv 



tional non-periodic features seen in Fig [3] (a) and (b) Q . 
However, the correspondence of these minima to simple 
fractions of the integer Landau indices is striking, sug- 
gesting that they might be precursors of the fractional 
QHE. The relatively low bulk mobility in the present 
samples (~400cm^/Vs) argues against such an interpre- 
tation, but on the other hand, it is not clear whether 
the mobility of the surface state is actually higher than 
that of the bulk. It is instructive to note that the integer 
QHE in graphene was seen for samples with mobilities 
around 40 times the present (bulk) mobility [26}. The 
distinct steps presently observed in Rxy at integer Lan- 
dau indices (reminiscent of the integer QHE) argues for 
a higher surface mobility. 

Except for the fraction 3/2, the observed fractions in- 
dicated in FigI3] are where the classic fractional quantum 
Hall effect (QHE) would be expected to be most robust. 
In semiconductors, the strongest even denominator frac- 
tion occurs at 5/2, a state that is both much weaker than 
odd-denominator fractions (22| and is unusual in that it 
is a spin-unpolarized FQH state f23|]. We note that the 
data in Fig. |31[b) show the even denominator and odd 
denominator fractions to be of similar strength. If these 
features are ascribed to the FQHE, this suggests that the 
strong spin-orbit coupling in a TI may enable the Dirac 
quasiparticles to condense into both symmetric and an- 
tisymmetric Laughlin wavefunctions 24 1 . 

By suppressing the bulk carrier density in 
(Bii_3;Sba;)2Se3 we have demonstrated that the 
transport properties of the metallic surface state of 
this topological insulator can be investigated in the 
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quantum limit. The application of high magnetic fields 
reveals quantum oscillations arising from this new 
two-dimensional system, including features at fields 
corresponding to fractional values of the integer Landau 
indices. As such, experimental access to the surface 
state of (Bii_2;Sb2:)2Se3 provides a new laboratory for 
studying topological quantum matter and potentially 
correlations among Dirac fermions 12 , . 
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